21. BPTT Quiz 2

_A folded RNN model_

A folded RNN model

Lets look at the same folded model again (displayed above). Assume that the error is noted by the symbol E . What is the update rule of weight matrix V1 at time t, over a single timestep ?

SOLUTION: Equation B

Solution

Equation B Is the only equation with the correct derivation of the chain rule with the proper use of the learning rate.

Next Concept